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Abstract — We analyze the outage performance of a two-way 
fixed gain amplify-and-forward (AF) relay system with beam- 
forming, arbitrary antenna correlation, and co-channel interfer- 
ence (CCI). Assuming CCI at the relay, we derive the exact 
individual user outage probability in closed-form. Additionally, 
while neglecting CCI, we also investigate the system outage 
probability of the considered network, which is declared if any 
of the two users is in transmission outage. Our results indicate 
that in this system, the position of the relay plays an important 
role in determining the user as well as the system outage 
probability via such parameters as signal-to-noise imbalance, 
antenna configuration, spatial correlation, and CCI power. To 
render further insights into the effect of antenna correlation and 
CCI on the diversity and array gains, an asymptotic expression 
which tightly converges to exact results is also derived. 



I. Introduction 

The commonly assumed one-way relaying protocol in the 
literature is limited in system throughput since two time 
slots are required per single transmission. The loss of system 
throughput can be recovered by exploiting the concept of two- 
way relay transmission [1]. Consequently, two-way relaying 
has attracted a lot of interest, e.g., [2]-[4]. 

In addition, multiple antenna deployment in fixed gain 
amplify-and-forward (AF) relay systems can bring further 
gains at a low practical implementation complexity. In partic- 
ular, hop-by-hop beamforming is a good technique to realize 
the benefits of deploying multiple antennas [5], However, 
due to space limitation in transmitters and receivers, antenna 
correlation can degrade the system performance. For one-way 
beamforming transmission, by considering antenna correlation 
at the transceiver, the performance of a dual-hop fixed gain 
AF relay network over Rayleigh fading channels has been 
investigated in [5], [6]. 

Besides antenna correlation, co-channel interference (CCI) 
presenting in cellular systems is another significant impairment 
that can degrade the system performance. Therefore, a substan- 
tial number of research works [7]-[10] have been carried out 
to investigate the effect of CCI on the performance of fixed 
gain AF relaying. The outage probability of a fixed gain relay 
system with CCI at the destination has been reported in [7]. 
In [8], the effect of multiple Rayleigh interferers at the relay 
has been quantified. In [9] and [10], the combined effect of 
CCI at both the relay and destination on the outage probability 
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has been investigated. However, the systems considered in [9], 
[10] are limited to single antenna model. 

In this paper, we consider a two-way relay system in which 
the source terminals are deployed with multiple antennas. 
Communication between the two users is facilitated using a 
single fixed gain AF relay. Furthermore, due to the use of 
multiple antennas, we consider beamforming and maximal 
ratio combining for coherent detection. To the best of the 
authors' knowledge, the effect of CCI on the performance of 
single or multiple antenna two-way AF relay systems has not 
been addressed. 

In particular, we derive a closed-form expression for the 
outage probability by considering antenna correlation at user 
terminals and CCI at the relay. In order to gain further insights, 
we also develop high SNR outage probability expressions. The 
asymptotic expression reveals that in a fixed and relatively low 
interference environment, antenna correlation of a full rank 
correlation matrix has no impact on the diversity gain, which is 
equal to the minimum number of antennas equipped at the two 
sources. In order to comprehensively evaluate the performance 
of two-way communication further, we analyze the system 
outage probability, where an outage event is declared when 
any of the two sources is in outage. Thus it is a measure of 
the overall Quality-of-Service (QoS) that the system can offer 
for two-way communication. We note that the system outage 
has not been widely understood even for simple single antenna 
two-way relay systems with no CCI effect. The obtained result 
highlights the significant role of relay placement on the outage 
performance. 

Notation: The superscripts T and f stand for the transpose 
and transpose conjugate. \\y\\ F denotes Frobenius norm of 
the vector y. Mx {•} is the expectation operator w.r.t. the 
random variable (RV), X. T (n) is the gamma function [11, 
Eq. (8.310.1)], r (a, x) is the incomplete gamma function [11, 
Eq. (8.350.2)], ip(x) is Euler psi function [11, Eq. (8.360.1)], 
Ei„ (x) = e~ xt /t n dt is the generalized exponential in- 
tegral function, and lC n (.) is the ?ith-order modified Bessel 
function of the second kind [11, Eq. (8.432.6)]. 

II. System and Channel Model 

Consider a dual-hop two-way AF relay network where 
two sources Si and S2 equipped with Ni and N2 antennas, 
respectively, communicate using a single antenna AF relay, R. 
The antenna arrays at Si and S2 experience spatial antenna 
correlation, which can be characterized by two spatial corre- 
lation matrices Si and S2, respectively. The communication 



between Si and S2 occurs in two hops. In the first hop, Si 
and S2 simultaneously transmit two messages si and s 2 to 
R. Assume that Si and S 2 have the perfect knowledge for 
channel state information (CSI) of the links to R, the transmit 
beamforming can be performed by multiplying si and s 2 
with weighting vectors wti and wt 2 , respectively. The signal 
received at R, corrupted by L interferes, is given by 
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- ft^Sj /2 w T iSi + /i 2 S2 /2 w T2 s 2 + 2~Z 9iXi + zr, (1) 



where h n — [/i n ,i, h n ,i, ■ ■ ■ , h n ^ n ] T , for n e {1,2}, is the 
N n x 1 channel vector from S„ to R with average channel 
power fi„, zr is additive white Gaussian noise (AWGN) 
with zero mean and variance N - In (1), xg and gg are 
the interfering signal and channel coefficient from the ^-th 
interferer to R, where E{|x £ | 2 } = Vg and E{|.g £ | 2 } = n 3t 
fori = 1,2,..., L. 

In the second time-slot, R amplifies j/r with the fixed gain 
Q before forwarding the resulting signal to both Si and S 2 . At 
each source, e.g., S 2 , the N 2 x 1 received vector signal y S2 is 
given by 

Vs 2 = G'E. 1 2 /2 h 2 E 1 1 /2 h 1 \NTis 1 + gZ 1 2 /2 h 2 h 2 Z 1 2 /2 w T2 s 2 

L 

+ gEl /2 h 2 J2g e x e + gEl /2 h 2 z R +z 2 , (2) 

e=i 

where z 2 is the A 2 x 1 AWGN vector with zero mean 
and variance Nq. Since each source node knows its own 
transmitted signal, S 2 can remove the self-interference part, 
i.e., the second term in (2), which requires the knowledge of 
j I{ = V e /N E{\g e \ 2 } 1 , I = l,...,L. We then multiply the 
received signal with an 1 x N 2 received weighting vector w^ 2 
to yield 



ys 2 = w R2 gE 1 2 /2 h 2 E 1 1 /2 h 1 w T iSi + 



+ w R2 gzl /2 h 2 ^g e x e +\N R2 gE. 1 2 / 'h 2 z R +w R2 z 2 . (3) 

e=i 

According to the principle of hop-by-hop beamforming [8], to 
maximize the signal-to-interference plus noise ratio (SINR), 
transmit weighting vector at Si, i.e., Wti, and receive weight- 
ing vector at S 2 , i.e., w R2 , are chosen as follows: 
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w T i = (Hffti)/ S^fti , w R2 = (S 2 2 ft 2 )/ 



From (3) and (4), the SINR at S 2 is expressed as 
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7s 2 



sy 2 ^ 



(4) 



(5) 



Without loss of generality, we assume that the two sources 
transmit the same amount of power, i.e., E{|si| 2 } = 

'R can convey these average values to Si and S2 and update them 
periodically using a low rate feedback channel. 



E{|s 2 | 2 } = V s . To maintain the average transmit power at 
the relay, the amplifying gain g is determined as 
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To simplify the notation, we denote 7„ = 7 

n 6 {1, 2}, and 73 = £/=i Vg/N Q \gg\ 2 , with 7 = V S /N Q . The 
instantaneous SINR at S„, for n £ {1, 2}, can be rewritten as 

7i72 



7s„ 



(7) 



7n(73 + l)+C 

where C is a constant given by C — V*/ (Nog 2 ), which will 
be derived in the sequel. 

It is important to obtain the statistical characteristics of RV 
7„, for n G {1,2}, given in (7). Without loss of generality, 
assuming that the correlation matrix S„ has Q n distinct 
non-zero eigenvalues A„i, X n2 , . ■ ■ , A„Q n with multiplicities 
ot n i, a n2 , . . . , a n Q n , respectively, the probability density func- 
tion (PDF) and cumulative distribution function (CDF) of 7 „ 
can be formulated as 



/7 " (7) l^knmxmv 

Qn a nl j-1 



(8) 



F 7n (7) = 1 
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where \m — X ni n n and the expansion coefficient d ni j 
defined as 



is 
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When the channels are independent, i.e., S„ is identity matrix, 



we have d r , 



1 for i 
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1,2, ...,N n and 
§ nlJ = for i = 1, j = 1,2,..., N n - 1. When the 
correlation matrix follows an exponential model, i.e., all the 
eigenvalues A n i, X n2 , . . . , \ n N n are distinct, we have = 



JV„ 



Xni ~v n (x ni Xnl)- 

Since 73 is the sum of L exponentially distributed RVs, 

its PDF is easily given by / 73 (7) = E£=iA ex p(^ 

where fa = 77/ Y[ k=1 ^g{l ~ Ihllh)' 1 - Usin g the above 
correlation model, constant C is obtained as 



Qi ai. 
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III. Outage Probability Analysis 



The outage event occurs when the instantaneous SINR falls 
below a predefined threshold. In this work, we consider the 
outage probability in two cases: i) the user outage probability 
at Si or S 2 and ii) system outage probability declared when 
the minimum SINR between Si and S 2 is below a threshold. 



A. User Outage Probability 

In this particular case, the outage probability is defined 
as the probability that Si or S2 is in outage, i.e., P out = 

Pr(7S„ < 7th) =F 7S „ (Pout). 

1 ) Exact Outage Probability: Consider the outage probabil- 
ity for S2. The exact CDF of 7s 2 is given by (see Appendix A 
for proof) 

Ql a ti j-1 n k 



x e 



-7th Kix 



10 EE 



k nk — l 



7th 



and fixed (7^ does not vary when the SNR is increased). On 
the other hand, when a symmetric network is assumed, such 
that the interfering terminals transmit with the same power 
characteristics as the useful terminals, (implying that the INR 
tends to infinity when the SNR tends to infinity) e.g., [8], 
[12], the diversity order becomes zero regardless of the use 
of multiple antennas at Si and S2. Result $>(l,t,k) in (15) is 
defined according to the relationship of the running indices I, 
t, and fc as follows: 

• If I + t — fc > 0, we have 
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When a particular channel correlation model is adopted, we 
can further simplify (12). For e.g., in the case of exponential 
correlation, (11) reduces to 
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If I + t - k = 0, we have $(Z, t, k) = $(t, fc), shown as 



*(*>*) =E? 



(17) 



For the case of independent fading, (11) simplifies to 



JVi-l 



1=0 
1 



-Tout - 1 ^ ^ i!(7"i)* r(JV 2 )( 7 J2 2 )«2 ^ J 2l J - 



If / + i - fc < 0, we have 
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(13) 

2) Outage Probability at High SNR: To provide additional 
insights into the behavior of the outage probability and to 
investigate the diversity order and the array gain of the system, 
we now present an asymptotic result. In the high signal-to- 
noise ratio (SNR) regime, i.e., 7 — > 00, we can express C « (fy 
where q is a constant, which results in (see Appendix B for 
proof) 
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For an exponential correlation model, C(#) given in (15) 
simplifies to 
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if JVi < A 2 
ifAi=A 2 =A 3 , (14) 
if JVi > N 2 
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where constant c^), for = min(iVi, N 2 ), is written as 
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Recall that 7 = Ps/A^o and 77, = Ve/N . In (14), we have 
assumed that the interference-to-noise ratio (INR), 7^ , is low 
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From (14), it can be observed that when the channel correlation 
matrices are of full-rank, the diversity order is equal to the 
minimum of antennas at Si and S 2 , i.e., min(JV 1 , N 2 ), which 
is the maximum achievable diversity gain, and that correlation 
does not affect the diversity order. 



B. System Outage Probability Analysis 

The two-way relaying concept considers information ex- 
change between Si and S2. Therefore, in some applications, 
successful transmission is declared only when both Si and 
S2 in operation. In other words, the considered system is 
suspended if any of Si and S2 is in outage [4]. We define 
the system outage probability as 



Pr(min(7 Sl ,7s 2 ) < 7th) ■ 



(21) 



Since the two RVs 7Sj and 7s 2 are dependent, in this case 
the mathematical derivation is much involved. Therefore, for 
the mathematical tractability, we omit the effect of CCI. The 
instantaneous SINRs given in (7) are now rewritten as 75 j = 
^^ 2 C for Si and 7s 2 = ^^_ 2 C for S2, which leads to 

■Pout = Pr [min(7 Sl , 7s 2 ) < 7th] 

= Pr (7Sj < 7th, 7S1 < 7S 2 ) + Pr (7S 2 < 7th, 7S 2 < 7sJ • 
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(22) 



Because of the symmetry between I x and I 2 in (22), we 
concentrate on X\. Since the condition 7Sj < 7s 2 is equivalent 
to 71 > 72, we obtain 

f°° /•^ + 2 7T 

Zi = J /71 (7i) J Ii2 (72) d7 2 d7i 
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where e = \ {^ x \\ + ^T^T+^TthC^) is the positive root of the 
quadratic equation -ff — 7th 71 — 7thC = 0. The exact expression 
for X\ is given by (see Appendix C for detailed proof) 
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Fig. 1. Outage probability of S2 with different correlation coefficients. 
Results are shown for L = 1 and i yj 1 = 1 dB. 
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Fig. 2. Outage probability of S2 with different antenna configurations. 
Results are shown for L = 3 and {7^ }f =1 = {1,2, 3} dB. 



The system outage probability is expressed in the form of 
one infinite sum which is shown to converge very fast. 
For example, only five number of terms is required in the 
summation over index s to achieve the accuracy to the degree 
of eight decimals. 

IV. Numerical Results and Discussion 

In this section, we provide numerical results to validate the 
above analysis. Here we apply an exponential-decay model 
for the path loss. Specifically, assume that the distance be- 
tween Si and S2 is equal to d, we have the corresponding 
channel mean power Qrj ~ dr^ 1 . Then, Oi = k~ m £1o and 
0,2 = (1 — M ^0, where n stands for the fraction of the 
distance from Si to R over the distance from Si to S2. For 
example, when the relay is located in the middle between Si 
and S2, we have k = 0.5. Moreover, an exponential correlation 
model is used where the correlation coefficient between the i- 
th and j-th antennas of S„ is given by p ni = pn~^ with 
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Fig. 3. Effect of CCI on the outage probability of S2 when 7/, = 7. 
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Fig. 4. User outage probability of Si, S2, and system outage probability 
versus the relative position of relay. 



i,j = 1,2, ...,N n and n = 1,2. In all examples, we set 
7th = 5 dB and Q,q = 1. Unless otherwise stated, R is located 
half-way between Si and S2, leading to f^i = = 16. 

Fig. 1 shows the outage probability of S2 for the case of 
Ni = 3, N 2 = 2 and a single interferer with 7^ = 1 dB. As 
expected, we see that high correlation adversely degrades the 
outage probability. However, only the array gain is affected 
by correlation while the diversity gain remains the same 
since the three curves are parallel as plotted in log-log scale. 
Moreover, the exact curves plotted from (11) are in excellent 
agreement with Monte Carlo simulations and the asymptotic 
curves plotted from (14) converge to the exact curves. 

Fig. 2 shows the outage probability for a fixed correlation 
coefficient, i.e., p\ = pi = 0.3, and L = 3 with {7j f }f =1 = 
{1,2,3} dB. To clearly highlight the effect of diversity, the 
antenna configuration at Si and S2 is selected as (N 1: N 2 ) = 
(2, 2), (3, 2), (3, 3). We notice that for a fixed Ni, increasing 
N 2 yields no additional diversity gain as the two systems (2, 2) 
and (3, 2) have the same diversity order. 



Fig. 3 illustrates the effect of CCI on the system perfor- 
mance by setting ji t proportional to the average SNR as 
lh — v l> where v is a fixed scalar. We see that, correlation 
significantly degrades the outage probability as all the curves 
exhibit a floor in the high SNR regime. It is interesting 
to observe that correlation improves the performance in the 
low SNR region. For low SNR, correlation allows potentially 
focused power, which is beneficial to the system performance 
[13]. This explains the observed effect in Fig. 3. 

In Fig. 4, in order to show the effect of the relay posi- 
tion, we have plotted the user and system outage probability 
versus the relative distance parameter k for the symmetric 
case, e.g., (Ni,N2) — (2,2), and asymmetric case, e.g., 
(N 1 ,N 2 ) = (2,4). When R is located nearby Si, we have 
k < 0.5. Notice that S2 outperforms Si when R is close to 
Si and vice versa, which shows that the first hop channel 
governs the user outage probability. In the considered system, 
interference at R is amplified before forwarding to a user, and 
it has a dominant effect when the first-hop link is strong. The 
system outage probability coincides with the worst case of Si 
and S2, as expected. The best performance for the symmetric 
case is achieved at k = 0.5, while it is interesting to see 
that in the asymptotic case, the best performance is obtained 
for k = 0.3. This observation shows that when the system 
is balanced, i.e., symmetric topology, R must be placed in 
the middle between Si and S2. However, for the unbalanced 
case, e.g., (Ni,N 2 ) = (2,4), R must be nearby Si. The shift 
of relay location to Si compensates for the imbalance of the 
system model. Specifically, in our example, Si has less number 
of antennas, hence, in order to achieve a compromise for Si 
and S2, a designer must carefully select the system parameters. 

V. Conclusions 
We have investigated the performance of a two-way fixed 
gain AF relay system with antenna correlation and CCI. In 
order to analyze the effects of these important practical impair- 
ments on the user and system outage probability, we derived 
the exact closed-form expressions. Moreover, asymptotic result 
providing further insights into array gain and diversity order 
was also obtained. We see that multiple antenna deployment is 
an attractive solution to improve the outage performance when 
the relay system is affected by low level of CCI. However, if 
the CCI effect is more severe, the performance significantly 
deteriorates. As such, multi-antenna interference cancelation 
schemes could be additionally implemented and considered 
for future work. 
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Appendix A 
The CDF of 7s 2 is written as 
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By substituting (8), (9) into (26) and applying the binomial 
theorem, we obtain 
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To solve the above double integral, we first expand (73 + 1) ; 
into a finite sum by using binomial theorem [11, Eq. (1.111)], 
and then use [11, Eq. (4.471.9)]. After some simplifications, 
we obtain (11). 

Appendix B 

Due to the space limit, we will briefly introduce the ap- 
proach to calculate the asymptotic result. First, we expand 

-Tth 

the exponential term e lx n into the infinite sum using Taylor 
expansion. Second, we employ series representation for Bessel 
function as 
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Depending on the relationship of the running indices I, t, and 
k, v = l + t — k can be positive, negative, or zero. When v > 
we utilize (28). When v < 0, we first apply K v (•) = /C_„ (•) 
and then (28). For zero value, i.e., I + 1 - k = 0, the following 
expansion is valid 

00 iz\ 2w 00 2w 
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(29) 

Then by substituting the partial coefficients for the terms 
7^, the sum of these terms becomes zero when n < 9. 
Therefore, the lowest order of the exponent n is equal to 9. 

Appendix C 
We first consider J\ given in (23) as 
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Now, by substituting (8), (9) into (30), and performing some 
manipulations yields 
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To the best of our knowledge, the integral in (31) has no 
closed-form solution. To solve this integral, we first apply 
binomial theorem [11, Eq. (1.111)] for term (71 + C) k and 
using Taylor series representation [11, Eq. (1.211.1)] for term 



e i^tii , which results in 
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The integral representation in (32) can be obtained in the form 
of the generalized exponential integral function Ei„ (•). 
Next, we evaluate J 2 given in (23) by rewriting it as 
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The above integral can be solved in the form of gamma 
function r(n) and incomplete gamma function T(n,x) with 
the help of [11, Eq. (3.381.8)]. Finally, we sum (32) and (33) 
and with rearrangement to arrive at (24). 



